Towards Better Test Coverage: Merging Unit Tests for Autonomous Systems$$^{\dagger }$$
نویسندگان
چکیده
We present a framework for merging unit tests autonomous systems. Typically, it is intractable to test an system every scenario in its operating environment. The question of whether possible design single multiple requirements the motivates this work. First, we formally define three attributes test: specification that characterizes behaviors observed execution, environment, and policy. Using merge operator from contract-based theory, provide formalism construct merged two specifications. Temporal constraints on guarantee non-trivial satisfaction both specifications necessary successful execution. assume environment remains same across test. Given synthesize policy filter using receding horizon approach, use guide search procedure (e.g. Monte-Carlo Tree Search) find guaranteed satisfy specification. This finds maximizes pre-defined robustness metric while guarantees satisfying prove our algorithm sound. Furthermore, approach synthesizing ensures scalable. Finally, show impactful designing efficient campaigns achieve similar levels coverage fewer executions. illustrate self-driving examples discrete-state setting.
منابع مشابه
Science-based Test Case Design - Better Coverage, Fewer Tests
This chapter describes an approach to test case design using a proven statistical method known as Design of Experiments. Benefits and costs quantified by a study comparing effectiveness of a manual test case design approach to effectiveness of DoE-based test case selection methods are described. In the interest of balance we discuss counter-arguments and limitations. We illustrate use of this m...
متن کاملPartial Ordering Unit Tests by Coverage Sets
A single software fault may cause several unit tests to break, if they cover the same methods. The coverage sets of unit tests may not just overlap, but include one another. This information could be of great use to developers who would like to focus on the most specific test that concerns a given fault. Unfortunately, existing unit testing tools neither gather nor exploit this information. We ...
متن کاملTowards Test Coverage Criteria for Visual Contracts
When testing component-based or service-oriented applications we cannot always rely on coverage criteria based on source code. Instead, we have to express our requirements for testing at the interface level. Specifying interfaces by graph transformation rules, so-called visual contracts, we define model-based coverage criteria exploiting the well-known relations of causal dependency and conflic...
متن کاملTowards a Taxonomy of Unit Tests
Not all unit tests are alike. Some tests are simple oneliners, while others contain a battery of assertions. Certain tests focus on a single method, while others test interactions between methods. There are even tests that do not contain assertions at all. This can make it difficult for a developer to understand which methods are tested by which tests, to what degree they are tested, and what t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2022
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-06773-0_7